Skip to content

feat: leg_corpus disk export + PEFT train/eval scripts - #58

Open
staticroostermedia-arch wants to merge 16 commits into
masterfrom
feat/leg-corpus-disk-export-peft-path
Open

feat: leg_corpus disk export + PEFT train/eval scripts#58
staticroostermedia-arch wants to merge 16 commits into
masterfrom
feat/leg-corpus-disk-export-peft-path

Conversation

@staticroostermedia-arch

Copy link
Copy Markdown
Owner

Summary

  • Persist full leg_corpus packs to disk (disk_export_path under data/lora-export/) so MCP responses omit large pack arrays (token-lean PEFT path).
  • Add scripts: export_leg_corpus_jsonl.py, peft_leg_geometry_train.py (QLoRA), eval_leg_geometry_gate.py, grow_leg_sft.sh.
  • Supports dual RSI Gemma track: packs → jsonl → PEFT → eval_gate without dumping corpus into chat.

Dual-loop stage pointer

  • Live stalk: helper:rsi_dual_loop_state — Gemma stage eval_gate (passed); Track S grew SFT to ~51 rows; next open: GGUF --lora serve, optional retrain.
  • MCP restart required after merge/install of this binary (engram-server change).

Test plan

  • cargo test -p engram-server --tests — 249 unit tests + store integration ok (local ship gate)
  • CI green on PR
  • After merge: rebuild + restart Engram MCP; confirm leg_corpus returns disk_export_path and packs: []

Write full leg_block packs to data/lora-export (disk_export_path) so MCP
chat stays token-lean; add export/train/eval/grow scripts for Gemma LoRA path.
Approved design for process verify packets, parent/child fire goals,
typed loop gates, and LEG Browser split-home glass box. Spec only;
implementation follows writing-plans after user review.
Task breakdown for schemas, loop prompts v2, parent goal runbook,
LEG ?view=glassbox split home, and PR #58 CI follow-up.
Parent/fire clicks use an in-view detail panel (layout overlay is hidden
in ?view=glassbox). Strip now shows hub_crs, hermies, and CI honesty pill.
Dual RSI Track S: scoreboard for glassbox schemas, fixture, eval_gate,
and SFT path without chat packs or PEFT retrain.
Operator surface: ./scripts/leg --live --glassbox prints and opens the
Glass-Box dual_loop / parent / last-fire UI without chat archaeology.
CI flake: verify_turn_record_llm_mcp_entrypoint fell back to heuristic
when parallel tests clobbered ENGRAM_LLM_URL. Hold CONTINUITY_TEST_LOCK,
save/restore env, harden mock server for multi-request serve.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant